QUANTITATIVE VERSION OF THE OPPENHEIM CONJECTURE 
FOR INHOMOGENEOUS QUADRATIC FORMS 
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Abstract. A quantitative version of the Oppenheim conjecture for inhomo- 
geneous quadratic forms is proved. We also give an application to eigenvalue 
spacing on flat 2-tori with Aharonov-Bohm flux. 



1. Introduction 

Let Q be a nondegenerate indefinite quadratic form on R™. Let £ £ W 1 be a vector 
and define the (inhomogeneous) quadratic form by 

(1) Q ( (x) = Q(x + £) forall iel n 

We will refer to Q = Qo as the homogeneous part of Qj. We say Q? nas signature 
(p, q) if Q does. Recall that a quadratic form is called irrational if it is not 
scalar multiple of a form with rational coefficients. In other words is irrational 
if either Q is irrational as a homogeneous form or if Q is a rational form then £ is 
an irrational vector. 

Let v be a continuous function on the sphere {v £ R n : \\v\\ — 1}. Define f2 = 
{v £ M™ : |H| < is(v/\\v\\)} and let TO be the dilate of fi by T. For an indefinite 
quadratic form Q in n variables and a vector £ £ R™ we let 

(2) N Qlil n(a,b,T) =#{ieZ" : x £ TCt and a < Q s (x) < b} 

If £ = we let NQ^o t Q(a,b,T) = NQ i n(a,b,T). It is easy to see that there exists a 
constant \q,q such that 

(3) Vol({a; £ R™ : igTO and a < Q ? (.t) < 6}) - A Q ,c ! (6 - a)T"~ 2 
A. Eskin, G. A. Margulis and S. Mozes in [EMM98] proved 

Theorem 1.1. ( |EMM98| Theorem 2.1]) Let Q be a quadratic form of signature 
(p,q), with p > 3 and q > 1. Suppose Q is not proportional to a rational form. 
Then for any interval (a, b) 

(4) V Q , n (a, b, T) ~ A Q ,rj (6 - a)T n ~ 2 as T -> oo 
where n = p + q and Xq.u is as in 

Theorem 11.11 fails if Q has signature (2,2) or (2,1). Indeed there are irrational 
forms for which along a sequence Tj, NQ t a(a,b,Tj) > T™ _2 (logTj) 1_c . However 
these irrational forms are very well approximated by split rational forms. Let us 
recall the following definition from EMM05 . 
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Definition 1.2. A quadratic form Q of signature (2,2) is called extremely well 
approximable by split forms (EWAS) if for every N > there exists a split integral 
form Q' and 2 < r E R 



(5) 



Q--Q' 

r 



1 

— Zjv 



where || || is a norm, fixed once and for all, on the space of quadratic forms in four 
variables. 

Recall from |EMM05] that if Q is irrational of signature (2, 2) then it has at most 
4 rational null subspaces. Let 

A -y , , m\ ,i \ r^r, x is not in a null subspace of Q 

(6) N Q , n (a,b,T) = # jzGZ : , e TO and a < g (x) < fe 

A. Eskin, G. A. Margulis and S. Mozes in [EMM05] proved 

Theorem 1.3. ( [EMM05] Theorem 1.3]) Let be as above. Let Q be an irrational 
quadratic form of signature (2, 2) which is not EWAS. Then for any interval (a, b) 

(7) N Ql n(a, b, T) ~ A Q) n (b-a)T 2 as T -> oo 
where Aq^q is as in and Nqxi is as in (0). 

This paper extends theorems II. II and ll. 31 to the setting of inhomogeneous quadratic 
forms. Let us first state the following which provides us with asymptotically exact 
lower bound. This indeed is the analogue of the similar result obtained by S. G. Dani 
and G. A. Margulis [DM93] , 

Theorem 1.4. Let be an indefinite irrational quadratic form inn > 3 variables. 
Then for any interval (a, b) we have 

(8) liminfj-^ N Q £,n(a, b, T) > \Q,n(b - a) as T -> oo 
where Aq.^ is as in (0) 

Proof. This theorem is obtained from theorems IA.3I and IA.4l below with arguments 
as in |DM93j or [EMM981 3.4,3.5]. □ 

We have the following 

Theorem 1.5. LetQ be an indefinite quadratic form of signature (p,q) wherep > 3 
and q > 1. Let £ E R.™ where n = p + q. Suppose that is an irrational form then 

(9) N Q ^ n (a,b,T) ~ \ Q , n {b- a)T n ~ 2 as T — s- oo 
where Aq.q is given in 0). 

As in [EMM98 we also have the following uniform version of theorem 11.51 Let 
I{p, q) denote the space of inhomogeneous quadratic forms whose homogeneous 
parts are quadratic forms of signature (p,q) and discriminant ±1. 
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Theorem 1.6. Let T> be a compact subset of T{p, q) with p > 3 and q > 1 and let 
n = p + q. Then for every interval (a, b) and every 6 > there exists a finite subset 
V of T> such that each Q{ G V is a rational form and for every compact subset 
F C T> \ V there exists Tq such that for all G F and T > Tq 

(10) (l-6)X Q . n (b-a)T n - 2 <N Q . cn (a,b,T) < (1 + 6)X Q . n (b - a)T n - 2 
where Aq.q is as in |3J). 

The proofs of the above theorems are straightforward inhomogeneous versions of 
the arguments and ideas developed in DM93 and EMM98 . 

As we mentioned before theorem 11.51 fails in signature (2,2) and (2,1). In this 
paper we prove an inhomogeneous version of theorem 11.31 Indeed as in loc. cit. 
one needs to assume certain " Diophantine condition^ on the quadratic form. Using 
similar ideas we also give a partial result in the (2, 1) case, see theorem 11.101 below . 
We start with the following definitions. 

Definition 1.7. A vector £ = (£i, • • • ,£„) € M™ is called K-Diophantine, if there 
exist K > and C — C(£) > such that for all < 6 < 1 and all rational vectors 
(21,-. ■ , £2.) <= Q™ with max, \q t \ < l/S we have 

(11) max\£i-Q\>C8 K 

i qi 

We say £ is Diophantine if it is K-Diophantine for some k. The following is our 
Diophantine condition on Q^. 

Definition 1.8. The irrational inhomogeneous quadratic form of signature 
(2, 2) is called Diophantine if either Q is not EWAS or £ is Diophantine. 

Let be a quadratic form of signature (2, 2). If L is a rational 2-dimensional null 
subspace of Q and £ € L + for some € Z 4 then the affine subspace L — V£ 
will be called an exceptional subspace of Q^. We will see that if either Q or £ is 
irrational then there are at most four subspaces L for which the above can hold. 
Let 
(12) 

A - r , i m\ n I x is not in an exceptional subspace of Qe 

N Q ,,Ma,b,T) = # |* € Z» : ^ g ^ J* q < fc 



The following is analogue of theorem II. 31 in the inhomogeneous setting. 

Theorem 1.9. Let be an inhomogeneous quadratic form of signature (2,2). 
Assume that is Diophantine. Then for any interval (a, b) 

(13) N Q , s , n (a, b, T) ~ X Q ,a(b - a)T 2 as T -> oo 

where Aq.q is as in |3J), and Nq^q is defined in \12\) . 

We now turn to the (2, 1) case. Our result in this case is more restrictive. As before 
we define the notion of exceptional subspaces for forms of signature (2, 1). These 
are affine subspaces L — such that L is a rational 1-dimensional null subspace 
of Q and £ e L + for some e Z 3 . The counting function, Nq^^q, is defined 
correspondingly. We have the following 
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Theorem 1.10. Let be a form of signature (2,1). If 

(i) the homogeneous part Q is a split rational form and 

(ii) the vector £ is Diophantine. 

then for any interval (a, b) 

(14) N Q ,t,n(a, b, T) ~ Aq,q(6 - a)T as T -> oo 
where \q t n is as in {3|) ; and Nq^^ is defined in U2\) . 

The proofs of theorems 11.91 and 11.101 require new ingredients combined with ideas 
developed in [EMM98] and EMM05 . Indeed what is new in theorem 11.91 compare 
to [EMM05] is the case when the homogeneous part Q is EWAS. An important 
especial case is when Q is a split rational form. In this case, and also theorem ll.101 
above, we need to study the contribution coming from null subspaces to the counting 
function N. This is done in sections [5] and [71 

Eigenvalue spacing on flat 2-tori. It has been conjectured by Berry and Ta- 
bor [BT77] that the the eigenvalues of a generic quantized completely integrable 
Hamiltonian follow the statistics of a Poisson point-process, i.e their consecu- 
tive spacings should be independent and identically distributed exponentially dis- 
tributed. Except some numerical experiments results which support the Berry- 
Tabor conjecture on a rigorous level have so far only been obtained for a statistic 
which is easier to handle. This is the pair correlation density function. 

Let the Hamiltonian be the geodesic flow for flat 2-torus. It was proved by P. Sar- 
nak |Sar96j that for almost all (with respect to Lebesgue measure on the moduli 
space of two dimensional flat tori) two dimensional flat tori the pair correlation 
density function converges to the pair correlation density of a Poisson process. He 
uses averaging arguments to reduce pair correlation problem to a problem about 
spacing between the values at integers of binary quadratic forms. This is related 
to the quantitative Oppenheim problem in the case of signature (2,2). One corol- 
lary of theorem II. 31 is that Berry- Tabor conjecture holds for pair correlation of two 
dimensional flat tori under certain explicit Diophantine condition. 

Similarly theorem 11.91 has a corollary in this direction. Let [) be a lattice in M 2 . 
Also let a = (ai, a.2) £ K 2 - Now the eigenvalues of the Laplacian 

d 2 d 2 

(15) ^ A = -W'W 

with quasi periodicity conditions 

(16) 4>{x + v)= e 2 ™ {a > v) 4>{x) for all i£l 2 and all v £ F) 

are of the form 47r 2 ||w + a\\ 2 where w £ f)* and f)* is the dual lattice to f). Let 

(17) < A < Ai < A 2 --- 

be these eigenvalues counted with multiplicity. By the Weyl's law we have 

(18) #{j : A, <T}~c„T 

where C(, = C0V ®J^ ■ Let ^ (a, b) and define the pair correlation function 



(19) R hta (a,b,T) = 



k) : < T, A fc < T, a < A, - \ k < b} 
T 
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Let now {11)1,11)2} be a basis for fj* and let /3 — (/3i,/?2) be so that fiiwi + P2W2 — 
a. Consider B{xi,X2) — 47r 2 ||a;iwi + X2W2 + a\\ 2 . Indeed the above mentioned 
eigenvalues are the values at integer points of the form Bp. Let £ = (/?,/?) £ K 4 
and define Q{xi, X2, £3, 2:4) = B(xi,X2) — B{x3,Xi). The pair correlation function 
for these eigenvalues, in the case ^ (a, b), is now asymptotically the counting 
function N QttQ (a,b,T), with n = {x : max( J B(xi , x 2 ) 1/2 , B(x 3 , x 4 ) 1/2 ) < 1}. Thus 
we obtain the following 

Corollary 1.11. Let f) be a lattice in R 2 and let B be the quadratic form obtained 
as above normalized so that one of the coefficients is 1 and let A\ and A2 be other 
coefficients. Also let vector a£l 2 be given and define (3 as above. Suppose that at 
least one of the following holds 

(i) The vector f3 = (/3i,^2) is Diophantine. 

(ii) There exists N, C > such that for all triples of integers (pi,P2,C[) with 
9>2, 

max 

i=l,2 

Then for any interval (a, b) with ^ (a, b) we have 
(20) lim Ru a (a,b,T) = c 2 (6- a) 

Hence the spectrum satisfies the Berry- Tabor conjecture for pair correlation func- 
tion. 

In the case f) = 1? this was proved by J. Marklof [Mark03 . His approach utilizes 
results from theory of unipotent flows combined with application of theta sums. 
We also use the theory of unipotent flows in our proof however our strategy to 
control the integral of unbounded functions over certain orbits is dynamical and 
rests heavily on |EMM98j and [EMM05] . 

Outline of the proof. Let be a quadratic form of signature (jp, q) and let n = p+q. 
Fix an interval (a, b) and let U C K" be a "suitably chosen" compact set such that 
a < Q(u) < b, for all u £ U. We want to count the number of vectors v £ Z n with 
T/2 < ||u + £|| < T, such that a < Q(v + f) < b. Note that SO(Q) acts transitively 
on the level sets of Q hence there exists some g £ SO(Q) such that g(v+£) £ U. Now 
if we let f(g{Z n + £)) = #Q?(Z" + f) n C/)^then ^(o, b, T) - N Q ^(a, b, T/2) can 
be approximated by the integral T n ~ 2 J H f(g(1, n +£))dg. Integrals of this form are 
the main object of study in EMM98] and |EMM05j . The question in hand is that 
of equidistribution results for unbounded functions. One obtains the lower bound 
by approximating / by compactly supported functions as it was done in [DM93 . 
However in order to obtain the upper bound one needs to deal with the structure at 
infinity of the space of lattices or in our case the space of inhomogeneous lattices. 

Acknowledgments. We would like to thank J. Marklof for reading the first draft 
and many helpful comments. 

2. Passage to space of inhomogeneous lattices 

As was outlined above, and is done in [EMM98 and [EMM05 , our approach is to 
translate the problem into a problem on homogeneous spaces and then borrow from 
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the rich structure in there. As we are working with inhomogeneous forms the space 
of main interest will be SL n (R) x IR n /SL n (Z) K Z n , which is naturally identified 
with the space of inhomogeneous unimodular lattices in R™. 

Quadratic forms. Let n > 3 and let n = p + q where p > 2. Let {e 1; • • • , e n } be the 
standard basis for M. n . If p > 3 let B be the "standard" form 

(i \ p n — 1 

^ ^e, = 2a; 1 a;„ + ^ *i - XI &? 
i=l / i=2 i=p+l 

Let ii = SO(B) and {a t } be the one-parameter subgroup of H given by a t e\ = 
e~*ei, a^ei = ej for 2 < i < n — 1 and ate n — e t e n . And let K = H O K where K is 
the group of orthogonal matrices with determinant 1. We let dk denote the Haar 
measure on K normalized so that K is a probability space. 

If (p, q) = (2, 2) we let 

(22) B(xi,x 2 ,x 3l x i ) = xiXi - x 2 x 3 

be the standard form on K 4 . This is the determinant on M^K), if we identify R 4 
with M2(K). Note that this identification shows that SO(2,2) is locally isomorphic 
to SL2(M) x SL2(M) with the action v — > givg^ 1 , which leaves the determinant 
invariant. We let H = SL 2 (M) x SL 2 (K), K = SO(2) x SO(2) and a t = (b t ,b t ) 
where b t = diag(e _t / 2 , e*/ 2 ). We let dk denote the Haar measure on K normalized 
so that if is a probability space. We will often work with the standard lattice Z 4 and 
the form Q in which case we continue to denote by {a t } and K the corresponding 
one parameter and maximal compact subgroup of SO(Q). 

If (p,q) = (2,1) we let 

(23) B(xi,X2,xs) = X1X3 — x\ 

be the standard form on M 3 . This is the determinant on Sym 2 (M), the space 2x2 
symmetric matrices, if identify R 3 with Sym 2 (M). This identification shows that 
SO(2, 1) is locally isomorphic to SL 2 (M) with the action v — > gv t g, where t g is 
the transpose matrix. We let H = SL 2 (K). We let a t — diag(e - */ 2 , e*/ 2 ) and let 
K = SO (2) be the maximal compact subgroup of H. As before dk denotes the 
normalized Haar measure on K. 

Let / be a continuous function with compact support on W 1 we define the theta 
transform of / by 

(24) /(A + 0= E 

where A + £ is any unimodular inhomogeneous lattice in R™. Note that / is a 
function on the space of inhomogeneous lattices. 

We fix some more notations. Let n = p + q and let G = SL n (R) x M. n . Let L = 
SL n (Z) x Z n which is a lattice in G. We have the following, which is similar to 
Siegel's integral formula. 

Lemma 2.1. Let / and / be as above. Let fi be a probability measure on G/Y 
which is invariant under W 1 . Then 

(25) f f(g)d^(g)= [ f(x)dx 

Jg/t jr» 
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Proof. Note that R n is the unipotent radical of G. Now the lemma follows from the 
fact that n is R n -invariant and Fubini's theorem. □ 

We end this section by recalling the definition of the a functions defined on the 
space of lattices. Let A be a lattice in W 1 . A subspace L of WL n is called A-rational 
if L n A is a lattice in L. For a A-rational subspace L let ^jp-y be the volume of 
L/(L n A). For < i < n define 

(26) ai(A)=sup<— — - : L is a A-rational subspace of dimension i 

[d(L) 

and let a (A) = max^a^A). Now if A^ = A + £ is an inhomogeneous lattice let 
a(Af) = a(A). There is a constant c = c(/) depending on / such that for any 
inhomogeneous lattice A^ = A + £ we have 

(27) /(A £ ) < c a(A e ) = c a(A) 

This is analogue of |Sch68| Lemma 2] and the proof is similar. 

3. The case of where p > 3. 

In this section we prove theorem 11.61 modulo results proved in appendix [X] As we 
mentioned the proof is an easy adaptation of the proof of 11.11 We include it for the 
sake of completeness. Hence through out this section we assume p > 3 and q > 1. 
Let us recall the following 

Theorem 3.1. ( [EMM981 Theorem 3.2]) // p > 3 and q > 1 and < s < 2 then 
for any lattice A in W 1 

(28) sup / a s {a t kA)dk < oo 

t>o Jk 

The upper bound is uniform as A varies over compact sets in the space of lattices. 

Theorem 11.61 is proved using the following which is a result of combining theo- 
rems O El and \KM We have 

Theorem 3.2. (cf. [EMM981 Theorem 3.5]) Suppose p > 3 and q > 1. Let f and f 
be as above. Let v be any continuous function on K. Then for every compact subset 
D of G/T there exists finitely many points x\, ■ ■ ■ ,Xf <E G/T such that 

(i) the orbit H Xi is closed and has finite H -invariant measure, for all i, 

(ii) for any compact set F C T> \ |J . H Xi there exists to > such that for all 
x 6 F and t > to 



(29) 



f{atkx)v(k)dk— I f ' dpL / vdk 
k Jg/t Jk 



< £ 



where pi is either the G-invariant measure on G/T or H k M. n x is closed and has 
H K WL n -invariant probability measure and fi is this measure. 



Proof. We may as we will assume that <f> is non negative. Now define 
(30) A(r) = {A 6 G/T : a x (A) > r} 
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Let g r be a continuous function on G/T such that <?r(A) = if A ^ A(r), g r (A) = 
1 for all A e A(r + 1) and < g r (A) < 1 if r < ai(A) < r + 1. We have 
/ = (/ — fg r ) + fg r . Note that / — fg r is a continuous function with compact 
support on G/T. 

Note that H° x R™ is a maximal connected subgroup of G. Hence for every S > 
there exists ro such that if H K M. n y is a closed orbit of H x M. n in G/T with an 
H x IR n -invariant probability measure a then tr(A(r) n H x M. n y) < S for any r > ro. 
Hence for r sufficiently large we get 



fdfj.- (/ - fg r )dfi 



(31) 

'G/r Jg/t 
where fj, is as in the statement of the theorem 13.21 

Recall that g r {y) = if a r < r. Let now /3 = 2 ■ 
depending on / such that we have 



< e/3 



s. There exists a constant -Bi 



(32) 



(fg r )(a t kx) v(k) dk 



K 



<Bir~^ I a(a t kx) 2 ~i\v{k)\dk 

k 



Hence if we apply theorem 13.11 then there is a constant B depending on B\ 
(33) 

for all x € T>. 



{fg r ){a t kx)v{k)dk < £>(sup |z/(fe)|)r 

K k<£K 



Now choose r > ro sufficiently large so that B(swp keK \v(k)\)r 2 < e/3. First note 
that applying theorem I A.4I with the bounded continuous function / — fg r there are 
points yi, ■ ■ ■ ,yk such that H x R n yj's are closed and have finite H x R™-invariant 
measure such that (|29|) holds for any x € I> \ U»=i K ^ n 2/i I0r / — /ffr instead 
of / and with e/3 instead of e. Now if we apply theorem IA.3I to H x M. n yi for all 
1 < i < k and V D H K R™yi and / — fg r . Then there exist x% ■ ■ ■ ,xi such that 
the conclusion of the theorem holds for / — fg r and e/3. Combining this together 
with (|3"Tj) and (|33[) and the choice of r we get the theorem. □ 



Proof of theorem \1.5\ and \l.b\ Theorem 11.51 is special case of theorem 11.61 The 
proof of theorem 1 1.6 1 now goes along the same lines as in |EMM98l Section 3.4, 3.5] 
replacing theorem 3.5 in |EMM98] by theorem 13.21 above. The proof is based on 
integrating equation (pM)) . 



4. The case of signature (2,2). 



We now turn to the more interesting case of signature (2,2). The proof is based 
on the same philosophy however since theorem 13.11 does not hold for cti in general 
the proof is more involved. In fact theorem 13.21 may fail in case of (2, 2) in general. 
It holds however under the Diophantine condition assumed above if we replace / 
by a modified function /. After this slight modification the main difficulty is to 
control the contribution coming from cti to integrals similar to those considered in 
theorem !3.2l In this section we make this reduction and the next section is devoted 
to the careful study of this contribution. The fact that we consider a slightly 
different function / is due to existence of exceptional subspaces which have of order 
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of T 2 solutions and is a minor point. They may exists even under Diophantine 
assumption, indeed we will show that if Q{ is irrational then there are at most four 
exceptional subspaces. 

Let be an inhomogeneous quadratic form of signature (2, 2) with discriminant 
1. Recall that the afhne subspace L — is called exceptional if L is a rational null 
subspace and £ € L + for some v% <E Z 4 . Indeed in this case L C Z 4 + £ and we 
will refer to L as an exceptional subspace of Z 4 + £. Let now q € SL^R) be such 
that Q(v) = B(qv) for all v € R 4 . Let A = qZ 4 and let A q? = q(Z 4 + £). Let X(A q? ) 
be the set of vectors in A q ^ not contained in qL where L C Z 4 for Q defined as 
above. Define 

(34) /(<?:A q£ )= M 

The following is analogue of [EMM051 Theorem 2.3] and will provide us with the 
upper bound required for the proof of theorem 11.91 The proof of this theorem is 
the main technical part of this paper and will occupy the rest of this paper. 

Theorem 4.1. Let G, K and {a t } be as in the section^ for the signature (2, 2) 
case. Let be a quadratic form of signature (2, 2) which is Diophantine. Let 
q € SL4(R) and A q £ be as above. Let is be a continuous function on K. Then we 
have 

(35) limsup / f{a t k : A q t)v(k)dk < [ f{g)dfi{g) [ v{k)dk 

t-nx> Jk Jg/t Jk 

where fj, is the G-invariant probability measure on G/T if the homogenous part, 
Q, is irrational and the H k R 4 -invariant probability measure on the closed orbit 
H X M 4 ■ Aq£ if Q is a rational form. 

Proof of theorem \1.9l Suppose is as in the statement of theorem 11.91 An 
argument like that of [EMM98, Section 3.4, 3.5] combined with theorem 14.11 gives : 
If i (a, b) then 

(36) limsup ATQ^n (a, 6, T) = limsup A^.n (a, b,T) < \q .n{b - a)T 2 

T-i-oo T-s-oo 

This upper bound combined with the lower bound obtained by theorem 11.41 proves 
theorem 11.91 

The proof of theorem 14. II will extensively utilize results and ideas from in [EM M98 
and EMM05 . We will try to use terminologies and notations used in loc. cit for 
the convenience of the reader. We recall these theorems and terminologies when 
we need them. Let us start with the following 

Theorem 4.2. Let {a t } and K be as in theorem \4-l\ Let A be any lattice in R 4 
then for i = 1, 3 and any e > 

(37) sup / oti(a t kK) 2 ~ £ dk < oo 

t>o Jk 

Hence there exists a constant c depending on e and A such that for all t > and 
< 5 < 1 

(38) \{k € K : a t {a t kk) > i}| < c6 2 ~ £ 
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Proof. The first assertion is proved in [EMM98| section 5] . The second assertion is 
a consequence of the first assertion and Chebechev's inequality. □ 

Such statement for ct2 however, does not hold in general. Hence in order to control 
the integral on the left hand side of (1551) we need to study the contribution coming 
from 02 to this integral under the imposed Diophantine condition. Let us recall 
the following standard 

Lemma 4.3. ( EMM05, Lemmas 2.1, 10.2]) Let Q be a homogeneous quadratic form 
of signature (2,2). Then /\ 2 R 4 decomposes into two SO <(Q) -invariant subspaces V\ 
and V-2- Let m denote the projection /\ 2 R 4 — > Vi- 

(i) The spaces Vi and V2 are orthogonal with respect to the bilinear form 
QW(v,w) = v A w on /\ 2 M 4 . The restriction of to Vi has signature 
(2,1). 

(ii) The pair (Vi, V2) determines Q up to proportionality and the map f which 
takes (Vi, V2) to Q / proportionality is a rational map defined over Q. 

(hi) IfV\ is rational and the restriction ofQ^ to V\ splits over Q then f{V\ , V^) 

is a split form over Q. 
(iv) Let L be a two dimensional subspace ofM. 4 and let Vi,V2 be a basis for L. 

Then the restriction ofQ to L is identically zero if and only if Tti(viAV2) = 

or iT2(vi A V2) = 0. 

Let A be a lattice in R 4 . If L is a 2-dimensional A-rational subspace of M 4 we let 
vi,V2 be an integral basis for L<~) A. We let v L — viAv2- We will refer to Z 4 -rational 
subspaces as rational subspaces. 

Definition 4.4. Let Q be a quadratic form of signature (2, 2). Fix < /ii < 1. A 
2-dimensional rational subspace L of R is called fii-quasinull with respect to Q if 

(39) IM^IHM^H < M i 

where ir^s are the projections corresponding to Q defined in lemma l4~3l 

If L is a quasinull subspace and T/2 < \\v L \\ < T then either || 7r 2 ) 1 1 < C/T or 
IKi(f L )|| < C/T, we call L quasinull subspace of the first respectively the second 
type. In particular null subspaces are quasinull and similar terminology will be used 
for null subspaces. This indeed depends on the ordered pair (Vi,!^)- We assume 
this ordering is fixed once and for all. In the particular case of Q = B we fix the 
ordering so that the space spanned by {in, X12} is of first kind. 

The following is a technically involved theorem which is proved in [EMM05] . It 
controls the contribution to ot2 coming from non-quasinull subspaces. 

Theorem 4.5. ( [EMM051 Theorem 2.6]) Let m > be fixed and let C t {5) be the 
set of all non- Hi- quasinull subspaces L such that for some k 6 K, d{a t kL) < 5. 
Then there exists 5q = 5q((j,i, Q) such that for all < S < 5q and all t > 



(40) 



I (J {k € K : d(a t kL) < S}\ < S 1 - 
LeCt(S) 
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Theorems 14.21 and 14.51 reduce the proof of theorem 14.11 to the study of quasinull 
subspaces. We finish this section by making this reduction explicit and also fixing 
some notations to be used in the next section. 

We first remark that in the proof of theorem l3.2l we need to chose /Ltj carefully, see 
section [5] for details. However until that section we will let < H\ < 1 be any 
small constant which is fixed through out and hence we will drop that from the 
notation. Let A q j be as in the statement of theorem 14.11 For A any lattice in R 4 
we let ai3(A) — max{ai(A), as(A)}. There are constants c and r depending on / 
and £ only, such that for all < S <C 1 we have 

(41) {k £ K : /(otfcA q£ ) > ^} C {k £ K : a 13 (a t fcA„ e ) > 1} U <B t (<5) U 2l t (<5) 

where 25 t (<5) = U.Le£ t (c5){^ e K ■ d(a t kL) < 5}. The set 21* (5) corresponds to 
quasinull subspaces and will be described below. Recall first that is an irrational 
form hence it has at most four exceptional subspaces. That is there are at most 
four null subspaces Li for 1 < i < 4 such that if £ £ L + v for some v £ Q 4 then 
L = Li for some 1 < i < 4. Let Q — Q(Q^) be the set of quasinull subspaces L 
such that L ^ Li for 1 < i < 4. If B(r) denotes the ball of radius r in R 4 let 

(42) 2l t (<5) = |J {k £ K : d(a t kL) < 6 & 3 v £ Z 4 s. t. a t k(L+v+£,)r\B{r) ^ 0} 

Lea 

Indeed an estimate like (|1T|) . actually for / would hold, by the virtue of |Sch681 
Lemma 2] if 21 was defined by taking union over all quasinull subspaces. But we 
have replaced / by / and this implies we can take the union over Q instead. To 
see this consider one of these subspaces e.g. L\. Assume £ £ L\ + where 
Wi£ £ Z 4 . Now if there is k £ K such that (|42]) is satisfied with L = L\ and 
v £ Z 4 . Then there is a constant > 1 depending on £ such hat d(atkH) < cgS 
where H = span(Li, v + Wig). Now either L\ = L\ + v + t; or H is a 3-dimensional 
subspace. We have excluded the points in L\ in the definition of / and if the later 
occurs then k £ {k £ K : as(a t kA^) > 1/c^S}. Hence there is c such that (|4"Tj) 
holds. 

Now the proof of theorem 14.11 will be completed if we can show that there is some 
i] > depending on Q{ such that |2lf(<5)| < S v , for all small 5. Such bounds in 
general do not hold. In the next section we will prove such bound for "most'' 
quasinull subspaces L under the Diophantine condition. 

5. Contribution from quasinull subspaces 

The reductions made in the previous section lead us to the study of quasinull 
subspaces. We need some further investigations before we can take advantage of 
the Diophantine condition. 

Until further notice we work with the standard form and the lattice A = qZ 4 . We 
will use the projections iri introduced in lemma 14.31 While working with A these 
are projections from /\ 2 M 4 onto Vi where Vi's are SO(J5) invariant. Similarly by 
a quasinull subspace we mean a A rational 2-dimensional subspace for which (|4.4|> 
holds with respect to these projections and some \i\ < 1. 
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We start by recalling some notations. Let Q = denote the set of quasinull 
subspaces which are not exceptional subspaces. For L £ Q we let 2lf (S) be the 
corresponding set defined in ((32). Let us recall from [EMM05 that the subset in 
the compact group K where the subspace L becomes "thin" can be approximated by 
union of at most four rectangles. We recall the precise statement which is tailored 
for our purpose in here. 

Lemma 5.1. Let L be a fi-quasinull subspace of first type. Let < i5 < 1 and 
t > 0. Then there exists < c < 1 such that 

(43) i? t i!±!± (c5,cJ) C {k £ K : d(a t kL) < 6} C |J Jif '^(c^S, c^S) 

± 

where R\ = I^ 1 (6) x L^ 2< " L \S) are boxes with the following properties 

(i) the intervals L^'^ L \d) have the same center for all t. 

(ii) the length 17^^^(5)1 « e~ t m t (L)~ 1 / 2 5 1 / 2 , where m t {L) = mirike k d(a t kL). 

(iii) For < n < 1 either \I^ 2(L) (S)\ < <f' or ||7r 2 (w L )|| < 

Furthermore if L is a null subspace ( of first type ) then 

(44) {k £ K : d{a t kL) < 6} C I? l(L) (6) x SO(2) 
where I^ 1 ^ {5) is an interval with above properties. 

Proof. Parts (i) and (ii) follow from [EMM051 Lemma A.6]. Note that if L is a 
null subspace as a consequence of lemma |4~31 above we have tt2(v l ) — hence L is 
invariant by the second factor which implies (|44|) . To see part (iii) note that the 
action of SO (2) on V2 is via the adjoint representation and bt expands e 2 A e4 by a 
factor of e* hence (iii) follows. □ 

The above lemma reduces our study to the investigation of the sets i?^(c _1 (5) = 
Rf' ± ' ± (c~ 1 5,c~ 1 5). In the rest of this section we will always assume that L is of 
first type. 

Recall that the set 2tf (S), which is defined in (l4"2"j) . is a subset of K where the 
subspace L has short vectors. Using theorem 14. 2 1 we may reduce to a subset where 
the shortest vectors are of approximately the same size, this reduction is done 
as follows; Let k £ 2lf(5) and let u%,U2 be two primitive vectors in L such that 
atkui, atku2 are successive minima of atkL. Let e > be small and let 
(45) 

x _ f, K 5 1+e < d(a t kL) < S & S 1 ^ < \\a t ku t (k)\\ < 5^ i = 1,2 1 
* l °' ej ~\ 3ueZ 4 suchthata t fc(L + u + £)nB(r)^0 J 

Let 2l^' 2 ((S, e) — Ui e g(2lf (5) \'Qif' 1 (S, e)), using theorem [4.2l we see that there exits 
[3 > depending on e such that |2lf ' 2 (S, e)\ < 6 1+ P. Hence we need to study the 
sets 2lf (5, e) — 2t { ' (S,s). Let Q t (S,e) be the set of quasinull subspaces which are 
not exceptional subspaces and for which 2tf (<5, e) ^ 0. 

Recall that L is a quasinull subspace of the first type, this means L is "almost" in 
Vi, see definition 14.41 Then I^ L '(S) is essentially the entire SO(2) in the second 
factor of K. Indeed if L is a null subspace then L is in V\ and I^ 2 ^ L \S) = SO(2), 
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as we remarked in lemma 15.11 Our goal in this section is to show that, under 
the Diophantine condition, we can get a better bound for the measure of those 
k G SO (2) which effect / i.e. there is a constant rj depending on the Diophantine 
condition and an appropriate choice of s such that for all small enough 6 we have 
|2lf (S, e)\ < \I^ 1 ^ L '(8)\S rl holds for "most" quasinull subspaces of first type L, see 
corollary 15.111 for a precise statement. 

For simplicity let £ = q£, where q G SL4(R) was chosen such that Q(v) = B(qv) for 
all v G R 4 . Fix t > and < S < 1. Let L G Q t (6,e) with T/2 < \\v L \\ < T. We 
also fix a small < e <C 1 to be determined later in the course of our analysis. Let 
ke G pi(2l t L (<5, e)) and let 

f <5 1+£ <d(a t (k e ,k^L) <S ) 

(46) E?(6,k e ,e)= fe, G SO(2) : min \ M k e , k)w \\ > 6 ±¥ 

Note that E^(S,ke,e) is an open set in SO (2). Further we have the successive 
minima of at(kg, k^)L are bounded by (J -3- and 5~z~ . 

Remark 5.2. Using reduction theory of orthogonal group we see that the lattice 
at{kg, fc^)A is "narrow" along L only. To be more precise we have if there is some 
A G A\ L such that a t (k g ,k,f,)(L + A) n ^ then A G L. 

Roughly speaking the general strategy now is to show that the following dichotomy 
holds: either there is one translate of L which always stays "close" to the origin, or 
different translates approach the origin in certain time intervals and after spending 
some time close to the origin move far away, see proposition 15.31 for the precise 
statement. If the second possibility holds for a subspace L then we use the special 
geometry of the lattice at (fee, fc^)A to guarantee that in the intermediate times there 
is no translate of L which intersects a fixed bounded neighborhood of the origin. A 
quantitative form of this argument is provided in proposition l5.3l below. Arguments 
of this kind are by no means new G. A. Margulis used a qualitative version of this 
argument in his proof of nodivergence for unipotent flows and after him these have 
been used to provide quantitative versions of nondivergence for polynomial-like 
maps by several people. We will then use the Diophantine condition to show that 
the first possibility cannot hold for "many" subspaces. 

Let us fix some more notations before proceeding. If k^ G E^(5, kg, e) is given 
then let = at(k$,k^)L, more generally for any x G K 4 denote (L + x)^ = 
at(ke, fc^X-L+x). For x G K 4 let x L<t> ± denote the projection of x onto the orthogonal 
complement of L^, the orthogonal complement is taken with respect to the usual 
inner product on R 4 . 

Proposition 5.3. Let r > be a constant and let B(r) be the ball of radius r in 
R 4 also keep all the notations from before. Then there exists an absolute constant 
c > such that for all < <5 <C 1 one of the following holds 

(i) there exists Al G A such that if for some A G A there is k^ G E^(S,kg,e) 
for which the plane (L + A + intersects B{r) then L + A = L + A^. 

(ii) for all A G A we have max^ \\(a t {kg, fc^)[A + CDl^II > g (i- e )/2 • 
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Furthermore if (ii) holds then there exists a computable constant n\ > such that 
for < e < 1/12 we have 

(47) \E?(5,k e ,e,Z) = {kj, £ E^(5,k e ,e) : 3X s.t. (L+\+(hnB(r) ? 0}| < 
where C > is a computable constant. 

Proof. Assume (ii) fails that is, there exists Ao such that || (at (kg, k ( / 3 )[Xo + C})L 4 ,- L \\ < 
[5 ( 1 _ c e ) /2 for all k<j, and all c > 0. This, for suitable choice of c, implies that (L+A +0</> 
intersects B( 4 r(i_ e )/ 2 ) for all fc^. Now suppose (L + A + Q)<f, n S(r) 7^ for some fc^ 
and A. Now remark \5 . 2 1 guarantees that for <$ <C r we have (L + A — Ao)^ = L$ and 
hence (i) holds. This establishes the first claim. 

Assume now that (ii) holds for some L £ Qt(<5, e) and kg G (S, e)). Denote 

by h\(4>) = \\(a t (kg, ktj,)(v L A (A + C))l|m, where || || m denotes the maximum norm 
on /\ 3 ]R 4 . Note that each function in the definition of h\ is a linear combination 
of {sin 1 </>cos J ' 4> : < i,j < 3}. Now using |KM98[ Proposition 3.4] we have; 
There are constant Ci,/3i > such that the function h\ is (Ci,/3i) good. It 
follows from the definition of (C, a)-good functions, see |KM98j . that f\((f>) = 
\\(a t (k e ,k^(v L A (A + C))|| is (C 2 ,/3 2 )-good for some C 2 ,/3 2 > 0. 

Recall now that 
(48) 

max fe06jE ||(a t (fc e ,fc )[A + C])L^II > ^1-0/2 
5 1+e < a t (k e , kj) < S for all fc^ G E^(5, kg,e,£) 
fx(<t>) = II (a t (k e , k^)(v L A (A + C))|| = \\(at(ke,kt)v L \\ \\ (a t (k e , fc*)[A + C])l^ II 

Hence we have max^ 

f\(<f) > = for all A G A. For A G A define 

(49) J x = {fc G SO(2) : f x (cj>) < |<^} 

The sets Jx's are open and an argument like that of the beginning of the proof 
using the estimates in (|48| shows that Ja's are disjoint. Define 

(50) E x = {k^£E^(S,k e ,e) : (L + A + 0* D B(r) ? 0} 

Note that for 4> £ E x we have /a(</>) < r<5 hence for <S<rwe have C J\. For 
each (f) £ J\ now let J/, (A) be the largest interval containing </> and contained in J\. 
Since /a's are (C 2 , /3 2 )-good we have 

(51) |{ 7 G : / A (7) < r6}\ < C(r,c 1 ,c 2 )5^ 1 ^MX)\ 

Let e < 1/12 and we let rji — /3 2 /4. Since J^A^s cover J\ and are disjoint we have 

(52) \E X \ < \{<P G J A : AW < rS}\ < C5*\J X \ 

Note that E[(8, kg, e, C Ua-Ea and E\ C Ja's are disjoint hence we have 

(53) 1^^,^,6,01 < Y, 1^1 ^ CT ' n E 1^1 ^ CTm 

A A 

This finishes the proof of the second claim. □ 

We now study more extensively the occurrence of case (i) in proposition 15.31 Thus 
let L G Qt(S,e) be a quasinull subspace with T/2 < ||v L || < T and let kg £ 
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pi(2lf (S, e)) and suppose Ao G A is such that (i) in proposition 15.31 holds with this 
Ao. Let < rj2 <C 1 be small number to be determined later. Define 

(54) E^(X ) = {k^eE^{S 1 k e ,e) : (L + A + 0* n B(r) 0} 

There are two cases to be considered either \E^(X )\ < S 712 , or |£: t L (A )| > S r ' 2 . The 
former implies the desired bound on the measure of %f(S, e) hence the later is the 
case which requires a more careful study. We start with the following 

Lemma 5.4. Let < r/2 < rji and the notations and assumptions be as in the above 
paragraph. In particular assume that (i) in proposition \5.3\ holds for some Ao G A 
and further assume that |£" t L (Ao)| > b" n2 . Then ||(Ao +C)i- L ll < 2rS T ^ , where r is 
as in the statement of of proposition 15. 31 

Proof. Note that the representation of SO (2, 2) on /\ 3 R 4 is the contragredient 
representation to the standard representation of SO (2, 2) on R 4 . More precisely, let 
&ijk — e i A e.j A e/c for 1 < i,j,k < 4. Then action of Ki fixes planes spanned by 
{ei34, 6123} and {e34i, 6342} and similarly Ki fixes the planes spanned by {ei23, em} 
and {e 34 i, e 342 }. Further a t ei 23 = e~'ei 2 3, a t ei 24 = ei 24 , a t e 34 i = e 34 i and a t e 34 2 = 
e*e 3 42. Now let w = (kg, e)(v L A(\ Q + ()), a = ||(A + C)l^I and for any £ E^(X ) 
let a = ||(a t (fc ,fc )[A o + (}) L ^\\- Recall that T/2 < \\v L \\ < T hence aT/2 < 
\\w\\ < aT. As was mentioned above K2 acts on the plane spanned by {ei23,ei24} 
by rotation on R 2 and ei23 is the contracting direction of {at}. Also note that we 
are assuming that |^^(Ao)| > S V2 . Hence there exist k^ G E^(X ) such that 

aTb m 

(55) < htikg,^)^ A(\ + ()}\\ =a (P \\at(kg,k l p)v L \\ 

Note now that we have < r and ||at(fce, k r j,)v L \\ < 6. So we get a < 2rS T V2 as we 
wanted to show. □ 



Before proceeding let us draw the following corollary. This will be used in the proof 
of theorem 14. II to control the contribution of "small" subspaces. 

Corollary 5.5. Let rji be as in vrovosition \5.3\ and let r/ 2 < ??i < 1/4. Then for any 
M > 1 there is a <5 = 8q{M, A) such that if S < Sq then for any L with \\v L \\ < M 
either E^(5, kg, e, £) < S' n2 or there is some A G A such that A + (eL. 



Proof. Suppose for some L we have E^{5,kg,e,^) > S m . Hence the conditions 
in lemma IST41 are satisfied for L and some A G A. This implies ||(A + C)l- l II < 
2rS T 112 < 2r8 1 ~ r < 2 . Now the assertion follows from discreteness of A together with 
the assumption that ||i; L || < M. □ 

It is now more convenient to work with Q and the standard lattice Z 4 . Hence from 
now until the end of this section by a quasinull subspace we mean a Z 4 -rational 
quasinull subspace. 

We are now ready to use the Diophantine condition. Let us start by recalling the 
following theorem which is proved in [EMM05] section 10]. This theorem deals 
with the Diophantine properties of the homogeneous part. It says "most" quasinull 
subspaces are null subspaces of a rational approximation of Q and in particular if Q 
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is not EWAS then there are not "many" quasinull subspaces. The precise statement 
is as follows 

Theorem 5.6. ([EMM05, Proposition 10.11]) There exists an absolute constant 
p > such that the following holds: Suppose Q is any irrational form of signature 
(2,2). Then for every sufficiently small > and every T > 2 one of the following 
holds: 

(i) The number of quasinull subspaces of Q of norm between T/2 and T is 
0(T 1 - T *). 

(ii) There exists a split integral form Q' with coefficients bounded by a fixed 
power of T T2 and 1 < A £ 1 satisfying \\Q — jQ'\\ < T~ p such that the 
number of quasinull subspaces of Q with norm between T/2 and T which 
are not null subspaces of Q' is 0(T 1_r2 ). 

We refer to section 10 of [EM M05] and also appendix |B] of this paper for a more 
careful analysis of this theorem. The main ingredient in the proof is the system 
of inequalities from [EMM98] . The main difference is that these inequalities are 
applied to a certain dilated lattice in /\ IR 4 = IR 6 . 

Let us now outline the rest of the proof. Let Q{ be the inhomogeneous quadratic 
form as in statement of theorem 11.91 We will apply the above theorem with ap- 
propriate parameters p, ti to be determined later. Let T > 2 be given. Now if (i) 
above holds, which is always the case if Q is not EWAS, then we already have a 
good control on the number of quasinull subspaces in question and we will get the 
desired control on the measure of the set U^Slf (5, e). Hence we may assume (ii) 
above holds. Again if L is not a null subspace of the appropriate approximation of 
Q we proceed as in case (i). So we need to consider the contribution from quasinull 
subspaces which are null subspaces of some rational approximation. In this case 
using lemma [5731 we will be reduced to the case where only one translate of L has 
contribution. We then will use the Diophantine property of £ and get a control on 
the number of such subspaces, this will complete the proof. 

We need to fix some more notations before proceeding with the above outline. If 
Q is a rational form we may choose \i\ small enough such that all /xi-quasinull 
subspaces are null subspaces. Also in this case, replacing Q by a scalar multiple, 
we may and will assume that Q is a primitive integral form. 

Let T > 2 be a fixed number. Recall from theorem 15.61 that there are two possibil- 
ities for quasinull subspaces. The case which requires more study is case (ii) so let 
us assume we are in this case. Let Qt = Q' (resp. Qt = Q) if Q is irrational form 
(resp. if Q is split integral form) where Q' is given as in (ii) of theorem 15.61 Let 
Qt(S,£,T2) be the set of all such quasinull subspaces (resp. null subspaces if Q is 
rational) which are not exceptional subspaces and such that 2l|(»,e) is nonempty 
for them. Let L 6 Q{(5, e, T2) be such subspace. We will further assume that L is 
of first type and that T/2 < \\v L \\ < T.. 

Since Qt is a split integral form, after possibly multiplying by a scalar bounded 
by a fixed power of T T2 , there exists a non singular integral matrix such that 
Qt(v) = B(pv). Further theorem 15.61 guarantees that we may choose p such that 
its entries are bounded by a fixed power of T T2 . Recall that the null subspaces of 
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B are of two types, based on the fact that the corresponding vector v L is in V\ or 
V2. From now on by a null space of first kind for B we mean 



Null subspaces of first type: These are subspaces which are orbits of 
under SL2 x SL2. 







Trough out the rest of the section, by a null subspace we mean a rational null 
subspace of the first type. Let now M be a rational null subspace of first type for 
B. Such subspaces are characterized as annihilator of primitive row vectors. Hence 

m \ / to 



an integral basis for M is ■jl ^ J ' y n J J ' w ^ cre § ca -( TO > n ) — L we wm * 
refer to this basis as standard integral basis for M. 

Recall that L G Q t (S, e,r 2 ) with T/2 < \\v L \\ < T. Since L is a null subspace of 
Qt the subspace M = pL is a null subspace of B. Now let {vi, v%\ be the standard 
basis for M and let Wi be the unique primitive integral multiple of p _1 Vi. Then 
{w\,W2\ is a basis for L. Further since p is an integral matrix whose entries are 
bounded by a fixed power of T T2 we have T 1 / 2-1 " 3 < \\wt\\ < T 1 / 2+T3 , where 73 is a 
fixed multiple of Ti- We will refer to the basis constructed in this way as r^-round 
basis for L. 

Fix < 772, £,72 <C 1 small parameters. These will be determined later. Recall 
that q G SL^IR) is chosen such that Q(v) — B(qv). Now let L be as above, 

further assume that there is kg G pi(^ L (S, e)) such that \E^ L (S, kg, e, £)| > S V2 , in 
particular (i) of proposition 15.31 holds for some A G A. Fix {wi,W2} a 73-round. 
Note that 73 is fixed when 72 is chosen. 

Let q _1 A = v G Z 4 . Now, using lemma [53 there is a constant c = c(q) such that 
\\( v + Oi x ll < — ~- This and the fact that L is a null subspace of Qt give 



(56) \(w t ,v + QT \<T 1 / 2+ ^ 



rp JU/2-T3 



where c is an absolute constant depending on Q. So {(wi ,C)Qt} — ^1/2 -t 3 1 where 
{ } denotes the distance to the closest integer. Let us now collect the result of the 
above discussion in the following 

Lemma 5.7. Let e and t-i be small and let L G Qt (5, e, T2). Let kg G pi(2t? L (S, e)) 
and suppose that \E? L {6,kg,e,£)\ > 6^ with T}2 as in lemma \5.4\ In particular 
(i) in vrovosition \ 5.3\ holds for qL and some A G A. Then {(wi ,^)qt} — £1/2- t 3 ; 
where T3 is a fixed multiple of Ti as above. Further since {wi,u> 2 } is the image of 
standard basis {i>i,V2} of M = pL then we have , P£)b} ^ • 

This lemma brings us to the situation where we can now use the Diophantine 
property of the vector £. 



As we mentioned in the brief outline following theorem 15.61 loc. cit. deals with 
the Diophantine properties of Q. If Q fails to have desired Diophantine condition £ 
needs to be a Diophantine vector thanks to our assumption on . In what follows 
we will make use of this assumption and control the number of quasinull subspaces 
for which lemma [5?7l can hold. 
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The following is a simple consequence of the definition 11.71 i.e. the Diophantine 
condition. The proof is easy, we include the proof for the sake of completeness also 
for later references. 

Lemma 5.8. Let x = (xi, • • • , x n ) G K" be a K-Diophantine vector. Then for any 
k' > (n + 1)k + 1 we have: For all j3 > and all < <y <C 1, if A € GL„(Q) ?s swc/i 
that ma,Xij{\Aij\, K^ -1 )^ |} < 7~' 9 , then Ax is (k' (3) -Diophantine. 

Proof. Note that the inverse matrix A" 1 is a rational matrix whose entries have 
denominators bounded by Cij~ n/3 where C\ is an absolute constant depending on 
the norm on R™. Let v = (^-, • • • , — ) be any rational vector with max^ \qi\ < 7~' 9 

such that max, \(Ax - v)i\ < C'^ K '^ . The vector v' = A^v = • • • , ^) is a 

rational vector with max^ \si\ < C 2 ^~^ n+1 ^ where C 2 is an absolute constant. We 
have 

(57) m^\(x-v'),\<\\A- 1 \\\\Ax-v\\<C 3 -f (K '- 1 '> and \s t \ < C 2l - {n+1)p 

i 

Now if one takes n' > (n + 1)k + 1 one gets a contradiction. □ 

Remark 5.9. Arguing as in the proof of lemma we can prove the following; For 
any t\ > we can choose < r = t{t\) such that if t 2 in theorem 15.61 is less than 
r then for all T > 2 we have: If max, \(p^) l - &\ < C(£)T- 2kti then \ qi \ > T Tl for 
all 1 < i < 4. 

As before, let {u>i,w 2 } be a basis for L which is the image of the standard basis 
{vi,v 2 } of M = pL. Replacing r 3 by 2r 3 if necessary, we have T 1 ~ T3 < ||vi|| 2 = 
m 2 + n 2 < T 1+T3 . The following is a consequence of lemma 15.71 and remark 15.91 

Proposition 5.10. Let rj\ be as in vrovosition 15.31 and let 772 < Vi- Then for any 

< Ti <C 1 we can choose t 2 small enough such that the number of quasinull 
subspaces L in Qt(S, e, t 2 ) with T/2 < \\v L \\ < T for which there exists some kg € 
Pi{%1 L {8,e)) such that \E? L {5, kg, s, £)| > 5 m is OiT 1 '^). 

Proof. We may as we will assume that L is of first type. We continue to use 
the notations as in lemma T5.7I in particular let M = pL and let {^1,^2} be the 
standard basis for M. Then loc. cit. implies that {(vi, p£) b} < Mjj^ ■ Recall that 
v\ — (rn, 0, n, 0) and v 2 = (0, m, 0, n) where gcd(m, n) — 1 and we have 

(58) T 1 ^ 3 < \\v M \\ = m 2 + n 2 < T 1+T3 , 

where T3 is a fixed multiple of the constant t 2 appearing in theorem 15.61 We also 
note that (vi ,p£) B = m(p£)4 - n(p£) 2 and (v 2 , p£Mp£)i ~ m (p£)3- 

Let t[ <C be chosen. Then choose t 2 in theorem 15 .61 such that t 2 < t(t[), where 
t(t') is given as in remark 1531 Hence we have; If maxi |(p£)i — |f| < C(£)T~ 2kt i 
then |g| > T Tl . Taking t 2 even smaller we may and will assume that T3 < r(/3. 

Now by lemma 15.81 we see that there is at most one primitive vector (a, b) with 
||(a,6)|| < T< such that; There exists (g-, ||) G Q 2 with < T< and 

,, q x k(pC)i - fobOa ~ frl < CT- 8 «^ 

1 ' \b(pOA-a( P 02~f 1 \<C'T-^ 
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Where C — C"(£) is an absolute constant depending on. If we choose 8 small 
enough our assumption in the proposition and our choices of r{ and T2 imply that 

(60) {{iH,P$b} < for i = 1,2 

Divide the range T 1_T3 < ||(m,n)|| < T 1+T3 into boxes of size T T>1 x T T i Now dSHJ) 
implies that; From each of these boxes there is at most one primitive integral vector 
(m,n) which can satisfy (|60|) . Hence the number of (m,n) such that (|60|) holds is 
0(T 1+T3_Tl ). The conclusion of the proposition thus holds with t\ — t[/2. □ 

Let us now summarize, in the following corollary, what we proved in this section. 
This is the precise formulation of what we called 11 our goal " in the beginning of 
this section. 

Corollary 5.11. There are positive constants rj and r and also constants C\, C2 > 
which depend on such that, if < S <C 1 is small enough then for all T > 2 
the number of quasinull subspaces L in Qt(5,e) with T/2 < \\v L \\ < T for which we 
have \Ip iqL) (S)\ > dS r ' is at most C 2 T 1 " T . 

Proof. Let r\\ be as in proposition 15 .31 and let r\i <r\\. Using proposition 15 . 101 there 
exists t\,T2 such that the number of I £ Qt(S,e, T2) with T/2 < \\v L \\ < T for 
which we have \E$ L {8,k 6 ,e,£)\ > 5^ for some k € pi(2t t qi (<5, e)), is 0(T 1_Tl ). On 
the other hands using theorem 15.61 we see that the number of quasinull subspaces 
with T/2 < H^ll < T and 2l t L (<5,£) ^ which arc not in Q t (5,e,T 2 ) is 0(T 1 ~ T2 ). 
The corollary follows with 77 = rji/2 and r = min{Ti, T2}. □ 

6. Proof of theorem 14. 11 

We will complete the proof of theorem 14. II in this section. Before proceeding to the 
proof we need the following two statements. 

Lemma 6.1. IfQ^ is an irrational (2,2) form. Then the number of 2- dimensional 
null subspaces, say L, of Q such that (£u|Jj for some v £ Z 4 is at most four. 

Proof. First note that using lemma 10.3 in |EMM05] we may and will assume that 
Q is a rational form. In this case we will actually show there are at most two such 
subspaces. In order to see this suppose that there are two null rational subspaces 
of the same type, say Li for i = 1,2, such that £ € Vi + Li where Vi £ Z 4 . Now 
since L^s are of the same type they are transversal. Let {w\,w 2 } be an integral 
basis for Li, then (£,w*)-B £ Z for i,j = 1,2. This thanks to the transversality of 
.Li's implies that £ is a rational vector which is a contradiction. □ 

The following is essential to the proof of theorem 14.11 and proved in appendix [B] 

Proposition 6.2. The number of quasinull subspaces with norm between T/2 and 
T is 0{T). 

As we mentioned this will be proved in appendix [B] However for the time being 
let us remark that in the case where Q is a split integral form this is immediate. 
Indeed in that case we are dealing with null subspaces and hence we need to show 
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this for Q = B. As we observed however the null subspaces of B are classified by 
primitive integral vectors (to, n). Now if L is a null subspace of either type which 
corresponds to (to, n) then ||i+| = m 2 + n 2 . Thus the result is obvious. 

We now turn into the proof of theorem 14.11 

Proof of theorem \4.1\ We may as we will assume that / is non negative. Now define 
(61) A(r) ={AeI : a x (A) > r} 

Let g r be a continuous function on X such that <7 r (A) — if A ^ A(r), <? r (A) = 1 
for all A £ A(r + 1) and < # r (A) < 1 if r < «i(A) < r + 1. Let the constant c, 
depending on / and £, be as in (|41|) and let s 6 N be a large number. Define 

{A : ; gr (A)>c2»} 



(62) (hr)f = {f9r)X{A : /g,.(A)<c2=} and (hr)t = U 9r)X 



Let now p, be as in the statement of the theorem. Since / — fg r is bounded and 
continuous, theorems IA.3I and IA.4I imply that 



(63) limsup / {f — f g r ){o-tkh.^)v{k)dk < / fd/u, / vdk 

t-Hx Jk Jg/t Jk 



Hence theorem 14.11 will be proved if we show that: Given e > we can choose ro 
such that if r > ro then limsup t J K fg r dk < e. 

Let now e > be an arbitrary small number. Let us first control the contribution 
of (fg r )f when s is large enough. Let M > be a number fixed for now and large 
enough such that < ^ , where C is a universal constant appearing in (|68|) and 
in particular is independent of /ii in the definition of quasinull subspaces. Further 
assume that M is large enough such that all exceptional subspaces have norm less 
than M. Let /ii in the definition of quasinull subspace be small enough such that 
for all L £ Qt(8,e) with ||w L || < M if L is quasinull then L is null. Let s > be 
large enough such that the conclusion of theorems 14.21 and 14.51 for this \i\ which we 
chose, as well as corollaries 15.51 and 15.111 hold for 6 = \ jV whenever j > s. Recall 
now that we have 

(64) {k £ K : f(a t kA 6 ) > cX} C {k £ K : a 13 (a t kA^) > V) u<B t (l)U2l t (^-) 

where 2l t (-L) and *B t (w) are as in (ED- Let £ *(ir) = i k e K : ^(atkA^ > 2^}. 
We have 



(65) 



f h>(a t KA qe )dk< *(\£t(l)\ + 1^(^)1 + 1^(^)1) 



s<j<t 



For any small e > and any quasinull subspace L let 2t£ (^j,e) be as before. 
Theorems 14.21 and 14.51 imply that if s is large enough then for all < e <C 1/20 and 
all j > s we have 

(66) 1*4)1+ 1*4)1+ 1*4) \ u ^4' £)|< 2t47 

Let rji < 1/4 be as in the proposition 15.31 and let rj = rji/2. The conclusions of 
corollaries 15 . 5 1 and 15 . 1 1 1 hold with this 77 and the corresponding r. Let now Qf{^j,£) 
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(resp. Qri^j, s)) be the set of quasinull subspaces in Qt(^-, e) with norm less than 

M (resp. greater than or equal to M.) We have 

(67) 

where C± and C2 are absolute constant independent of The inequality in the first 
line above follows from corollary 15.51 and the fact that the definition of Qt(w> £ ) 
excludes exceptional subspaces. The inequalities in the second line follow from 
corollary 15.111 We now have 



here C is an absolute constant which depends on C in (fS5|) . This inequality together 
with gives 

(69) J (Jg r )>(atKA q6 )dk < ^ + C(i + _L) 

Recall that M was chosen such that -p- < e/6. Now we choose s large enough such 
that the right hand side of is less than e/2. The above estimate holds for all r. 

As we mentioned in the proof of theorem 13.21 There exists tq = ro(s, e) such that 
if r > r then (j,(A(r)) < e/2 s+1 . Let r > r (s, e). We have 

(70) limsup/ (fg r )f(a t kk^)v(k)dk < 2 s limsup / g r (a t kk^)v(k)dk < e/2 

t— foo Jif t->oo JK 

Thus dZOj) and ([69]) give: If r > r (s,e) then 

(71) limsup / fg r {a t kk q ^)dk < e 

t-s-oo J k 

This finishes the proof of theorem 14.11 



7. Proof of theorem 11.101 

The proof of theorem ll.lOl is very similar to that of theorem 11.91 Indeed our study 
in this case is simpler as we are dealing with the case where the homogeneous part 
Q is rational. Hence we only need to consider the contribution of null subspaces to 
the counting function. 

As before let q G SL 3 (R) be such that Q(v) = B(qv) for all v £ R 3 . Since Q is 
rational we may assume q is in PGL^Q), let p e GL^Q) be a representative for 
q. Let A = qZ 3 and define A q? = q(Z 3 + £). As in section H] let A(A q5 ) be the 
set of vectors in A q ^ not contained in qL where L C Z 3 is an exceptional (one 
dimensional) subspace for Q. An argument like that in lemma 101 shows there are 
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at most 3 such subspaces when Q is rational and £ is an irrational vector. For any 
continuous compactly supported function / on R 3 define 

(72) /(.9:A qC H E M 

Discussions as before, reduce the proof of theorem II. 101 to the following theorem. 

Theorem 7.1. Let G, H, K and {at} be as in section\^for the signature (2, 1) case. 
Let be a quadratic form of signature (2, 1) as in the statement of theorem \1.10\ 
Let q G SL3(R) and be as above. Let v be a continuous function on K. Then 
we have 

(73) limsup / f(a t k : A^)v{k)dk < j f{g)dfi{g) [ v{k)dk 

t->oo Jk Jg/t Jk 

where [i, is the H K R 3 -invariant probability measure on the closed orbit H K R 3 ■ A q £. 

The proof of this theorem is very similar to that of theorem 14.11 We will use 
the same notations as the previous sections for the sake of simplicity. The main 
notational difference to bare in mind is that in previous sections L would denote a 
2-dimensional subspace where in this section L is a one dimensional (null) subspace. 

As before we need to study the subsets of K where the function / is "large" . We 
start by recalling the following; There is c > such that for all large t and small 
< S -c 1 we have 
(74) 

c 1 1 

{k e K : f(a t kA^) > -} C {k € K : ai(a t fcA q5 ) > — } U{fc G K : a 2 (a t fcA^) > -} 

We fix t and 8 as above. Let us make two important remarks before we continue. 
The second name author would like to thank A. Eskin for conversations regarding 
this remark. 

Remark 7.2. (i) Using reduction theory of the orthogonal group we see that: 
if a2(a t kAq£) > i, then actually ai(a t kA q ^) > i. Hence we only need to 
study the contribution coming from ot\. 
(ii) The fact that Q is a rational form implies that there exists 5o depending 
only on Q such that if < S < 5a and ai(atkA^) > i, then there is 
a null subspace L such that ai(atkA^) = d ^ kL ^ ■ This follows because 
Q(Z 3 ) = B(A) is a discrete set and atk is in the isometry group of B. 

The second remark above is the main reason for our assumption, Q is a rational 
form. It is also the main reason we can handle this case in hand despite the more 
complicated case where Q is an arbitrary form. 

Given these two remarks and arguing as in section 21 we actually need to consider 

the set 

(75) 

2l t ((5) = [J {k € K : d{a t kL) <5&3veZ 3 s. t. a t k{L + v + q£) fl B(r) ^ 0} 

where Af is the set of null subspaces of Q which are not exceptional subspaces and 
B(r) is the ball of radius r in M 3 . We will show that; There exists r] > depending 
on the Diophantine properties of £ such that: at most S v of null subspaces can have 
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nontrivial contribution to ffT5]) . This will finish the proof of theorem 17.11 as we will 
see. 

Let us remark that; The null subspaces coincide with the orbit of ^ X ^ jj under 

the action of SL2 (R) described in section [5J With this identification and using a 
theorem of Borel and Harish-Chandra, see the discussion in appendix B below, the 

primitive null vectors are identified with the SL2(Z) orbits of vectors ^ jj 

under the same action. In what follows we will restrict ourselves to the +1 case. 
These are described as follows; For any primitive vector (m, n) the corresponding 

(Tft^ 77177 \ 
2 J • For any such subspace, M say, we 

let v M denote this vector which we will refer to as the standard basis for M. 

For any null subspace L of Q the subspace pL is a (rational) null subspace of 
B, we let v L denote the standard basis for pL. For any such L let 2lf (<5) be the 
corresponding set in (|75j) . We have the following 

Lemma 7.3. There exists < 771 <C 772 < 1 depending on the Diophantine prop- 
erties of £ such that if < 8 <C 1 is given and T > 8~ m , then the number of null 
subspaces L with T/2 < \\v L \\ < T such that 2lf (<5) 7^ is 0(8 Vl T). Furthermore 
there are at most two subspace L with \\v L \\ < 8~ m for which {(v L , p£)s} < O(S). 
The implied constants in the O-notation depend on Q and £ . 



Proof. First note that with the description of null subspaces of B, which was given 
above, we see that the number of primitive vectors w with T/2 < \\w\\ < T and 
B(w) = is 0(T), see appendix B below for a discussion of similar statements. 
Let now L be a null subspace with 2lf (8) 7^ and suppose v L corresponds to the 
primitive vector (m,n). We have 

(76) {(v L , pOb} = n 2 (pOi - 2mn(p02 + ™ 2 (p£) 3 < c8 

where c is an absolute constant depending on Q and r. Since £ is Diophantine 
lemma [5781 implies that p£ is Diophantine as well. 

Note that no three v L lie on one plane in R 3 . Hence using lemma [5751 we see that 
there exists 772 depending on Diophantine properties of p£ such that ([To]) cannot 
holds for more than two L's with ||v L || < 8~ m . 

By virtue of Weyl's exponential sum estimates, see theorem 2.9, proposition 4.3 
and theorem 8.6 in |GT08) . we see that there are absolute constants Co, c\ > 1 such 
that for all small enough 8 and all < 771 < 1; If (176]) holds for more that 8 Vl T 
subspaces L with T/2 < \\v L \\ < T, then there exists k e Z with |fc| < 8^ Cl111 such 
that 

(77) max{fc(p£)J < c Q 8~ Cim /T 



Now let r/2 be chosen as above and choose 771 such that 7/2 > (ci + n)r)i, where k 
is the Diophantine exponent of p£ and c\ is the constant appearing in (|77j) . With 
these choices we see that if T > 8~ m then f77|) contradicts Diophantine assumption 
on p£. Hence ([76"1) can hold for at most 8 Vl T subspaces as we wanted to show. □ 
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Before starting the proof of theorem 1 7. II we need to recall the following definition 

(78) 7 t L (<5) = {keK : d(a t kL) < 5} 

Some important properties of these intervals were proved in [EMM05] and recalled 
in lemma 15.11 What is important for us in this section is the property (ii) in 
lemma [53] This property, tailored to our current assumptions, gives 

(79) \^(S)\<\I t L (S)\ " 



T 



Proof of theorem \7.1\ Let M be a large number which is fixed for now. Let t > 
be a large number. Assume j is a large number also. We assume through out that 
Tj = rji where rji is as in lemma [7T3l Let Lq, Li be nonexceptional null subspaces such 
that {(v Lk , pOb} < 1/2 J for k = 0, 1, and that \\v Lo \\ < \\v Ll \\ are minimal with 
these properties, indeed we fix any two such subspaces if there are more than two 
subspaces satisfying these conditions. Assume that e*/2 J ' + * 0+ < ||u L || < e t /2 3+l °. 
We need to consider two cases 

Case 1. Assume that |ji> L °|| > 2 J>?2 , where 772 is as in lemma 17731 



Now using lemma 17.31 we see that for all i < iq the number of null subspaces L, 
with e*/2 J ' + *' +1 < < e*/2 i+i such that {(v L , p£) B } < l/2 j , is bounded by 

e* /2( 1+Tl >i +i . Also by our assumption in case 1 for all i > io the subspaces of norm 
at most e*/2 i+J ' have no contribution to the set 2l t (l/2 J ) i.e. 2lf (l/2 j ) = for all 
such subspaces L. 

Hence if we use this fact and we have: If j is such that case 1 holds then we 

have 

(80) 

1 U ^)i <£ E i^)i^^E 2 ^ /2 ^^) 

inull 1 . f ■ 1 ■ <\\v L \\<-si~ l 

Case 2. Assume || -u^ 1| < where 772 is as in case 1. Note that there are at most 
two subspaces with this property as was shown in lemma 17.31 We need to consider 
the following possibilities 

(i) M < e t /2 io+ 'J < 2^2. We then have 

(81) |3lf fc ( — )| < Ce-^e^-^—y 1 ^-^ < C ^ , , k = 0, 1 
Now if we argue just as in case 1, we get 

(82) 1 U a* L (^)i<£ E i^)i^(s^) 

inull i -^^h^ik-^ 

(ii) e t /2 t0+: > < 2 j712 < M. Note that we have i k = i k (j), where k = 0, 1 and for 
each j there are at most two such ik's. We will denote by L(j,ik) the subspace 
corresponding to i k = ife(j), for k = 0, 1. We have 

(83) |2l^' A) (l)| < Ce-H^ < Ce-*/ 2 , k = 0, 1 



INHOMOGENEOUS QUADRATIC FORMS 



25 



(iii) e t /2 l0+: > < M < 2 J,)2 . Given M, this can only hold for at most two subspace 
L° M and L\j furthermore there exists £ — l[M) such that if this holds for j > I 
then these are exceptional subspaces which we have excluded already. Hence we 
assume this holds only for j < £. We have 

(84) |2lf"(^)| < \lj/ M (l/2 j )\ < e~* /2 2^' /2 for j < I and k = 0, 1 
We collect these estimates in the following 

(I) Es<j<i 2 J 2 j(i + „) < 

(HI) £ s <,<i£S-M 2^e-*/ 2 < M^e-*/ 2 
(IV) Exj^e-h-i < e-M 

Fix e > arbitrarily small. Let 77 be as before. Then we may choose M = M(e) 
and t = t(M, e) > and s — s(r], e) > large enough such that 

(85) 23 \ U 2tf(l)|<C(^ + -l= + Mi e -*/ 2 + e ^2l)< e /4 
s<J<* Lnull 

The proof of the theorem 17.11 is now completed similar to that of theorems 13.21 
and 14.11 Indeed in order to control the unbounded part of the integral one uses 
remark [7. 2 1 and reduces to the study of null subspaces. The required estimate for 
null subspaces then is provided by (f85|) above. 



Appendix A. Equidistribution of spherical averages 

Let G be a connected Lie group and F a lattice in G. we let 7r denote the natural 
projection from G onto G/F. Let H be a connected semisimple subgroup of G and 
let K be the maximal compact subgroup of H. The question which is addressed 
in this section is that of equidistribution of sets of the form atKx, where x G G/T 
and A = {a s : s € K} is a suitable one parameter subgroup of H. This is a 
well-studied question. The main tools, in the analysis, are indeed Ratner's theorem 
on classification of unipotent flow invariant measures on G/T and linearization 
techniques for the action of unipotent groups on G/T which were developed by 
Dani and Margulis.. 

Let H and W be closed subgroups of G. Following Dani and Margulis [DM93 define 
X(H, W) = {g e G : Wg C gH}. We recall the following 

Theorem A.l. [DM93, Theorem 3] Let G be a connected Lie group and T a lat- 
tice in G. Let U = {u t } be an Ad-unipotent one parameter subgroup of G. Let (j) 
be a bounded continuous function on G/T. Let T> be a compact subset of G/T and 
let e > be given. Then there exist finitely many proper closed subgroups Hi = 
i?i((/>,2?,e), • ■ • , Hk = Hk(4>,L), e) such that Hi f]T is a lattice in Hi for all i, and 
compact subsets Ci = Ci(0, V, e), ■ ■ ■ ,C k = C k {4>,V,e) of X{H X ,U),- ■ ■ ,X(H k ,U) 
respectively, for which the following holds: For any compact subset F ofT>\[J i CiT/T 



2(5 



G. A. MARGULIS & A. MOHAMMADI 



there exists Tq > such that for all x G F and T > Tq we have 




Jo jg/t 



where dg is the Haar measure on G/T. 

We will apply the above theorem to a special case which we now describe. Let 
us fix a few notations to be used through out this section. Let G — SL„(R) x R n 
where as before we are considering the standard action of SL n (R) on R™. Let •& 
denote the natural projection from G onto SL n (R). Let n = p + q where p > 2 and 
q > 1. Let H = SO(p,q) and K = SO(p) x SO(q), and let H° denote the identity 
component of H. We let Hi C H be the subgroup that fixes {e^, ■ ■ ■ , e n -i} then 
H\ = SO(2, 1). Hence there is a homomorphism p with finite kernel from SL2(R) 
to Hi C H° such that A = {a s : s G R} = p(diag(e s / 2 , e~ s / 2 )) is a self-adjoint 

one-parameter subgroup of SO(2, 1) and U — {u t : ( £ 1} = /)( J * ) is the 

corresponding expanding horospherical subgroup for s > 0. 

Note that the standard representation of H° on R™ is irreducible hence H° is 
a maximal connected subgroup of H x R". Note also that as H° is a maximal 
connected subgroup of SL n (R) we have that H° x R n is a maximal connected 
subgroup of G. 

Let now L be a lattice in G. Then L n R™ is a lattice in R™. We let A = i?(T) = 
r/m R™, this is a lattice in SL n (R). We will abuse the notation and let also 
denote the projection from G/T onto SL n (R)/A. We have 

Lemma A. 2. Let x G G/T then the orbit Hd{x) is closed in SL n (R)/A if and only 
if H x R™ x is closed in G/T. 

Proof. Note that closed orbits of H x R n (resp. H) have a finite H x R™-invariant 
(resp. i7-invariant) measure by section 3 in Mar86j . Let x = (g,v)T. Note that 
H x R™ x — i9~ 1 (Hi}(x)) hence if the Hd{x) is closed so is H x R" x. Suppose now 
that H x R n x is closed. Then Ti = H x R™ n {g, v)T(g, v)- 1 is a lattice in H x R n 
and hence Ti nR" is a lattice in R" and Ti/Ti nl" is a lattice in H. Hence H<&{x) 
is closed, as we wanted. □ 

The following is special case of theorem 4.4 in |EM M98 . 

Theorem A. 3. Let the notation be as above. Further assume A is a lattice in 
H° x R™. Let (j> be a compactly supported continuous function on H x R"/A. Then 
for every e > and any bounded measurable function v on K and every compact 
subset T> of H x R"/A there exist finitely many points x\, ■ ■ ■ ,Xf. £ H x R™/A 
such that 

(i) the orbit H° x. L is closed and has finite H° -invariant measure, for all i, 

(ii) for any compact set F C T> \ [L H x% there exists sq > such that for all 
x G F and s > Sq 



(87) 
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We will also need a slight variant of theorem 4.4 in EMM98 . This is the content 
of the following 

Theorem A. 4. Let G, H, K and T be as above. Let A = {a s : s £ R} be as above 
also. Let (f> be a compactly supported continuous function on G/T. Then for every 
e > and any bounded measurable function v on K and every compact subset D of 
G/T there exists finitely many points x±, ■ ■ ■ ,xi £ G/T such that 

(i) the orbit H k R™ x\ is closed and has finite H tx W l -invariant measure, for 
all i, 

(ii) for any compact set F C T> \ (J ; H >< M. n Xi there exists sq > such that for 
all x £ F and s > sq 



/ <f>{a s kx)v(k)dk 
Jk 



f cpa 


g v dk 


/G/T 


JK 



< e 



Proof. The proof of this theorem goes along the same lines as in section 4 in |EMM98] . 
Let U be as defined above. Let Hi — Hi(<j>, KV,e) and Cj = C %{<!>, KV,e) for 
i = 1, • • • , k be given as in theorem I A. 1 1 corresponding to U. For 1 < i < k define 

(89) g t ^{geG : KgcX(Hi,U)} 

Note that the group generated by [J keK k~ 1 Uk is H° as U is not contained in any 
proper normal subgroup of H and K is the maximal compact subgroup of H. Let 
now g e Qi then k~ x Uk C gHig^ 1 for all k e K. Hence H° C gHfg^ 1 . Now as H° 
acts irreducibly on M™ the only possibilities for gH^g -1 are H° and H° X M. n . Thus 
we have 

(90) gH^g- 1 C H° «R n for any g e Qi, l<i<k 

We also note that if g € G is such that gH°g^ 1 C H° rt" then g e iVsL n (ffi) (^°) x 
M n . This fact and ([90]) say that if fli, <?2 G ft for some z then 1 g2 G A'smr) (-ff ) x 
E™. Since H° x R™ is of finite index in iVg Ln ( R )(ff) x M" we get ft can be covered by 
finitely many co sets of H° k R™. Hence there are finitely many points x\, ■ ■ ■ ,xgG 
G/T such that H K R™a;i's are closed and have a finite X R™-invariant measure 
for all 1 < i < t and that 

(91) ljftr/rc (J fixftj 

i l<i<£ 

Note that since X(Hi,U)'s are analytic submanifolds of G and if is a connected 
we have that for any g £ G \ (J. ftT/r 

(92) |{fceif : fc 5 €yx(fli,cr)r}| = o 

Now l[9T|l . ([92 ]1 and the fact that d C X(H i} U) give 

(93) \{k£K : kx£\JC t T/T}\=0 

i 

for any x 6FcD\[J i ffK K n Xi. Now if we apply lemma 4.2 in EMM98 then 
there exists and open subset W C G/T such that \J i dT/T C W and \{k £ K : 
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kx € W}\ < e. Recall that d = Ci(4>,KT>,e), hence there exists Tq > such that 



(94) 



a/r 



< e 



for all y £ KV \ W. So we have 
<f>{utkx) 



(95) 



o Jk 



G/r 



A" 



i^cZA; < sup |^(fc)|(l + 2 sup \(j){y)\)e 
k&K yec/r 



The rest of the argument is mutatis mutandis of the proof of theorem 4.4 in EMM98 
replacing theorem 4.3 in loc. cit. by what we proved above. □ 



Appendix B. Number of quasinull subspaces 

This section is devoted to the proof of proposition [572J We will need results proved 
in |EMM05l Section 10]. We will recall the statements in here for the convenience 
of the reader. 

Consider the bilinear form in 6- variables Q^(v, w) — v A w. Then V\ and V2 in 
lemma [4731 are orthogonal with respect to this form and the restriction of to 
has signature (2,1). The following is a proved in the course of the proof of theorem 
10.4 in }EMM05j . 

Proposition B.l. (cf. [EMM05, Section 10]) Let r > be any sufficiently small 
number and let T > 2. There exists a rational three dimensional subspace U of 
/\ 2 R 4 . With a reduced integral basis of norm at most T T whose projections into V2 
have norm less than T r such that one of the following holds 

(a) The restriction of to U is anisotropic over Q. In which case (i) in 
theorem 1 5. 61 holds. 

(b) The restriction of to U splits over Q. In which case (ii) in theorem \5.6\ 
holds. Furthermore in this case Q' as in loc. cit. is proportional to f(U, U ) 
where U' L is the orthogonal complement of U with respect to and f is 
as in lemma \4-S\ Moreover the number of quasinull subspaces with norm 
between T/2 and T which are not in U or U 1 - is 0{T 1 - T ). 

Let us denote by Q^(v) the restriction of to U. As we mentioned before 
this is a form with signature (2, 1) and U is a rational subspace. If L is a quasinull 
subspace with T/2 < ||w L || < T then we have (v L ) = 0. Hence if L is a quasinull 
subspace in U then Q( 3 \v L ) = 0. In other words the proposition 16.21 will follow 
from the following 

Proposition B.2. Let Qq(x, y, z) ~ 2xz — y 2 be the standard quadratic form of 
signature (2,1) onM 3 . Let A = gT? where g G GLa(Q). Let T > a large parameter 
and let r be a sufficiently small parameter. Assume that the entries of g are rational 
numbers whose nominator and denominators are bounded by a fixed power of T T 
and also suppose that |detg| < T T . Further assume that the length of the shortest 
vector in A is c — 0(1). Then ifT is large enough we have 

(96) #{we-P(A) : QoM=0 and \\w\\ <T}< 0(T) 

where "P(A) denote the set of primitive vectors in A. 
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Proof. Let H C SL3(R) be the subgroup which preserves the form Qo- Note that 
H is a Q-group and that H ^ SO(2, 1) as Q-groups. Let L = SO(Q )(Z). Let 
C = {w G R 3 : QoM = 0} be the light cone of Q and let C fl = {meC : #/2 < 
IIH < R}, for any R > 0. Note that C is dilation invariant. Let A = disc(A) 1 / 3 and 
define Ai = j A. The lattice Aj is unimodular and the length of the shortest vector 
in Ai is at least j. Let g £ PGL 3 (Q) denote the image of g. Indeed Aj = gl? . 
The counting problem in (|96p will follow if we show that 

(97) #{w G 7>(A X ) : QoH = and ||w|| < ^} < O(T) 

A 

Let L g — H n gSL 3 (Z)g _1 . Since <? is rational matrix r ff is a lattice in iJ. Further 
we have that the form Q g = gQ^g* is a split form over Q and hence F g is a 
nonuniform lattice. Let L m be a maximal lattice such that Y g C F m . There are 
only finitely many classes of maximal nonuniform arithmetic lattices in H. Hence 
we will assume F m is in the same class as L in the rest of the argument. Thus 
r m = ft-mF/i" 1 where h m £ H(Q) and H is the adjoint form of H. Now using 
reduction theory of the orthogonal group there is a universal constant C such that 
we can find v £ V(h m J?) n C with \\v\\ < C. We also have the shortest vector in 
h m l? is at least T~ kT where A: is a fixed number. 

Since both g and h m are in PGL3(Q) we can find a primitive vector vq £ 'P(Ai) 
which is a scalar multiple of v. Note that \\vq\\ > j- Let P = Stab(Ru) be a maximal 
Q-parabolic subgroup of H. Let P = AN be the Levi decomposition of P. We have 
N-v — v and A acts on v by a character. By a theorem of Borel and Harish-Chandra 
there is a finite set 3 C H(Q) such that H(Q) = F m SP(Q). Thus the F m -orbits 
are characterized by the values of the character on j4(Q). By Witt's theorem we 
have that H(Q) acts transitively on the rational points on the cone C. Hence we 
see that C n 'P(Ai) C F m Suo. As 5 is a finite set we only need to consider F m t>o. 

Let ei = (1,0,0) and let Nq C H be the stabilizer of e±. Let Br = {h £ H : 
h • ei G Cr} and let Br = Br/Nq. Let now xr denote the characteristic function 
of Cr Define the following 

(98) F R (h) = XR(hjv) for h G H 

r m /r m nN 

This is a function on H/Y. Now using the well-developed machinery for counting 
problems using mixing property, see in particular B O07] and |.MS08j . there exists 
s > depending only on the spectral gap of H and t such that 

(99) F R (e) = IN °I^ T K o\(Br)(1 + 0(vol(^)- £ )) 

where vol denotes the H invariant Haar measure on H/N. Hence we have 

(100) #(r m w nC fl ) < F B/ ||^||(e) = O[R/\\v \\) 

Since ||uo|| > t, this finishes the proof. □ 
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